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Abstract 


We show that sublinear-space bounded real-time Turing machines (be they determinis- 
tic or nondeterministic) are equivalent to finite automata. Non-regular real-time definable 
languages (and also quasi-real-time languages, their nondeterministic extension) can thus 
only be accepted with O(n) work space. 


1 Introduction 


The oldest model of real time is probably the real-time Turing machine [14]. These machines (and 
their languages, called real-time definable) have been studied extensively 9} [11]. 
The real-time Turing machine is deterministic, though nondeterministic extensions were also 
studied [21 |6]. 

Questions about multiple tapes, multiple heads, and other extensions were thus addressed. 
By contrast, little attention has been given to the space bounds of real-time Turing machines. 
We address this issue partially in this paper, by finding a significant gap in the space hierarchy 
of real-time Turing machines: We show that any language that is accepted by such a machine 
using sublinear space is equally acceptable by a finite automaton, and that nondeterminism 
does not influence this gap. 

We believe that this gap shows the limitation of the Turing machine model in the area of 
real time. 


2 Preliminaries 


Given some alphabet A, the set A‘ is defined recursively by A! = A, and A’ = A x A‘! for 
i> 1. The empty word is denoted by e. We assume familiarity with Turing machines; the 
following is only a sketch definition given for completeness (and to summarize notation). 

For some constant k, k > 1, a (k-tape) deterministic Turing machine is a tuple M = (K,~,6,50), 
where K is the set of states, not containing the halt state h, so € K is the initial state, Ł is the 
tape alphabet containing the blank symbol #, and 6 is the transition function, 5: (K x £*) — 
(KU {h}) x ({R,L,N}‘ x £*); R, L, N govern the head move, with L standing for “left,” R for 
“right,” and N for “no move.” A configuration of M is a tuple (q, MALY iy - + ,Xkaākyk), where q 
is the current state, x;a;y; is the content of the i-th tape, and a; is the symbol that is currently 
scanned by the head of tape i, 1 <i < k. A configuration C; yields in one step another config- 
uration C2, written C1 Fm C? iff C2 can be obtained from C; in one application of ô. As usual, 
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3, is the transitive and reflexive closure of Fm (with the subscript often omitted when there is 
no ambiguity). 

A nondeterministic Turing machine is identical to a deterministic Turing machine, except 
that 5 C (K x £*) x ((KU {h}) x ({R,L, N}* x £*)) (so that a configuration can nondetermin- 
istically yield in one step more than one configuration). 

A Turing machine M is said to accept some input w iff M stops (that is, M reaches the halt 
state h) on w; that is, M accepts w iff (so,w,€,...,€) F jy (h, w1,..., wg) for some w; E€ L*, 1 <i<n. 
M accepts a language L whenever M accepts w iff w € L. 

A Turing machine is f-space bounded [8] iff the first tape is read-only and for any con- 
figuration C = (q,w1,W2..., Wk) such that (so,w,e,...,€) H* C for some word w € 2*, we have 
|w;| < f(|w|) for every 2 < i < k. In other words, the size of any possible configuration of a 
machine working on w is bounded by f(|w|) (save for the first tape which however becomes 
read-only; this allows the definition of sublinear space bounds). 

We use one of the several equivalent definitions of real-time Turing machines: 

For some constant k, k > 1, an on-line Turing machine is a deterministic (k + 1)-tape Turing 
machine (with k working tapes and one input tape) M = (Kp © Ka, £, 8,s0), where 5: (Kp x 
x x LK) U (Ka x L*) — (Kp UK, U {h}) x ({R,L,N}* x £*). The head on the input tape is al- 
lowed to move only to the right. A configuration of an on-line k-tape Turing machine becomes 
C = (q,t,x101Y1,.--,X~aY~), Where q is a state, t € L* is the (not yet considered) content of the 
input tape, x;a;y; is the content of the i-th working tape, and a; is the symbol that is currently 
scanned by the head of tape i, 1 < i < k. The set of states is divided into two subsets: the set of 
polling states Kp and the set of autonomous states K,. All the states that lead to h in one step are 
polling states, and the initial state is a polling state. In addition, the relation F Įm has the follow- 
ing property: if q E€ Kp, q” € Ka, and q’ € Kp U Ka, then (q,abv, x1,..., Xp) Fm (q',b0,x4,..-,X4), 
(g",abv,x1,..., Xk) Fm (q',abo,x4,...,X;,), and (q,€,x1,... Xk) Fm (h,€,%4,-.-,%,). M accepts the 
input w as usual. 

A real-time Turing machine is an on-line Turing machine for which K, = 0. A language ac- 
cepted by such a machine is called real-time definable. The languages accepted by nondetermin- 
istic real-time Turing machines (defined identically to the real-time Turing machine except for 
the nondeterminism) are called quasi-real-time languages [2]. 

In summary, an on-line Turing machine has a unidirectional (and read-only) first tape 
(called input tape). It has therefore no knowledge about further input data. Between read- 
ing two input symbols, such a machine is allowed to go into a number of autonomous states, 
where it performs some work without considering any input. In addition to these require- 
ments, a real-time Turing machine has no autonomous state, it being forced to consume an 
input datum at every step. 

A (nondeterministic) finite automaton is an on-line Turing machine with no work tapes 
(that is, no memory). For a deterministic finite automaton the set of autonomous states is fur- 
thermore empty_} It is known however that deterministic and nondeterministic finite automata 
accept the same class of languages (called regular languages) [8]. 


3 Small Space Real-Time Turing Machines Cannot Count 


The purpose of the work tape(s) of a Turing machine is to keep some information about the 
input; such an information is updated as the machine runs and becomes the basis of the final 


1Finite automata are typically defined differently [8], but we find this definition convenient given that we al- 
ready introduced on-line and real-time Turing machines. 
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decision of the machine to accept (or not) the input. Given the treatment of input in on-line 
(and thus real-time) Turing machines we refer to the process of managing such information 
as counting. Indeed, such a machine sees the input one symbol at a time; it can then update 
(or not) the extra information stored on its work tapes. Such an update consists at the very 
least in the incrementation or decrementation of a counter. The processing could be of course 
more sophisticated, but we are going to show that not even incrementing /decrementing can 
be achieved in real time on sublinear space, so taking the simplest processing into account will 
suffice. 


Lemma 1. A sublinear-space bounded real-time Turing machine (deterministic or nondeterministic) 
cannot count any quantity in w(1). 


Proof. Let the input string be w of length |w| = n. 

Consider a real-time Turing machine with one counter that needs to count some quantity 
g(n) € w(1). This counter can only be represented in unary notation, for indeed any other en- 
coding requires in the worst case a non-constant time for incrementation (and decrementation)— 
this is caused by the carry that is generated by an incrementation and will eventually need to 
propagate throughout the number in any other encoding than linear. It follows that g(n) can 
only be sublinear. 

Note further_that a real-time Turing machine cannot know n in advance of reaching the 
end of the inpuf4 and cannot therefore anticipate—not even by a nondeterministic guess, since 
such a guess implies trying all the possible variants—any bound for g(n) (so that it can stop 
on exceeding the bound). An input that does not belong to the language can then bring g(1) to 
linear, thus causing the Turing machine to exceed its allotted space (that g(n) can be linear for 
a not necessarily acceptable input w is immediate using an information-theoretic argument). 
Counting beyond w(1) is therefore impossible. oO 


Theorem 2. The languages accepted by sublinear-space bounded real-time Turing machines (determin- 
istic or nondeterministic) include exactly all the regular languages. 


Proof. Since sublinear-space bounded real-time Turing machines cannot count beyond O(1) 
(Lemma[l) then their work memory is useless. Indeed, counting up to O(1) can be easily done 
using the finite state control, as commonly done for finite automata. o 


Corollary 3. Non-regular real-time definable languages exist and can only be accepted using Q (n) 
space. 


Proof. This is a direct consequence of Theorem[2] The only thing that needs consideration is the 
existence of non-regular real-time definable languages. Such languages can be easily found, 
one of the most immediate being {a"b" : n > 0} (known non-regular and acceptable by a real- 
time Turing machine that uses a single counter). O 


4 Conclusions 


We identified quite easily a gap in the space complexity of real time. This gap is considerably 
wider than for classical Turing machines (from constant to linear in real time as opposed to 
from constant to log log in a non-real-time setting (13). 


2 And not even then if it does not have access to linear space on the working tape, as seen here; this is however 
forward looking and therefore a circular argument. 
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We regard such a wide gap as an emphasis of what has been more or less subconsciously 
the belief in the computing field, namely that the real-time Turing machine is too weak a model 
to capture the actual phenomena that take place in the real world; not even the nondetermin- 
ism helps in this respect. The extremely simple computation engine of a Turing machine is 
particularly well suited to analyze computations in general, but it is apparently too simple to 
be really useful in real time. The random access machine (RAM) is a marginally richer model 
(that performs elementary arithmetic operations in constant time) and can easily accomplish in 
real time and logarithmic space all the processing implied in Lemma[I](that is unavailable to 
the real-time Turing machine with sublinear space). 

Overall, it appears that the real-time Turing machine does not have a niche. Indeed, the 
model of choice for real time in formal methods is either the finite automaton [12] or the very 
powerful timed transition system [3]|4]. As we saw (to some degree) here, such choices are not 
accidental. 
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